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09/900,565 

Kevin E. Spaulding, et al. 

July 6, 2001 

2672 

YANG, Ryan R. 
4100 

0505.0044C 
27896 

Method for Representing a Digital Color Image 
Using a Set of Palette Colors 




MAIL STOP AF 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 

Sir: 

The stamp of the U.S. Patent and Trademark Office placed hereon will indicate the date 
receipt of the following: 

Transmittal; 

Amendment (11 pages); 
. ^Associate P owrr of Attorney^ - 
Petition for Extension of Time; and 

Check No. 7750 in the amount of $1 10 for the extension fee. 



Hand-Delivered: 
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AMbr^MENT OF SlPAULDING, ET AL. 
APPUCATIONNO. 09/900,565 
Attorney Docket No.: 0505.0044C 

IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Appl.No. : 09/900,565 

Applicant : Kevin E. Spaulding, et al. 

Filed : July 6, 2001 

TC/A.U. : 2672 

Examiner : YANG 3 Ryan R. 

Confumation No. : 41 00 

Docket No. : 0505.0044C 

Customer No. : 27896 

Title Method for Representing a Digital Color Image 

Using a Set of Palette Colors 



Mail Stop AF 

Commissioner for Patents 

P.O. Box 1450 

Alexandria, VA. 22313-1450 

Sir: 



Amendment under 37 £FR 



In response to the Office Action mailed February 25 a 2004, please amend the above- 
identified application as follows, without prejudice. 



Amendments to the Claims are reflected in the listing of claims which begins on 
page 2 of this paper. 

Remarks/Arguments begin on page 6 of this paper. 
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atvtb-^jment of spaulding, et au 

application No. 09/900,565 
attobmey docket no.: os05.0044c 
Pace 2 of 11 

Amendments to the Qairos: 

This listing of claims will replace all prior versions, and listings, of claims in the application. 

Listing of Claims: 

1. cancelled. 

2. (currently amended) The method of claim 1 rlaiin iq i wherein the 
distribution of pre-defined important colors includes a distribution of skin-tone colors. 

3 . (currently amended) The method of claim 1 claim 19. wherein the 
distribution of pre-defined important colors includes a distribution of neutral colors. 

4. (currently amended) The method of claim 1 claim 19, wherein the 
distribution of pre-defined important colors includes a distribution of sky colors. 

5. (currently amended) The method of eterar4- claim 19^ wherein determining 
the supplemented distribution of colors is accomplished by appending additional pixels to the 
input digital color image to form an enlarged input digital color image, where the color of the 
additional pixels is distributed according to the distribution of pre-defined important colors, 
and then detennining the distribution of colors in the enlarged input digital color image. 

6. (currently amended) The method of ekfeari claim 19. wherein the set nf 
palette colors is determined using a sequential scalar quantization algorithm. 

7. (currently amended) The method of claim 6 A wherein the sequential scalar 
quantization algorithm includes the atopo of; 

i) sequentially paxtitioniiig the colors of the supplemented distribution of colors 
into a set of color space regions; and 

ii) detennining the set of palette colors by selecting an output color for each 
color space region in the set of color space regions. 
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Page 3 of 11 

8. (currently amended) The method of claim 7 ft further including carnrjrisjng: 
determining the color value for each pixel of the output digital color image by 

identifying the palette color corresponding to the color space region containing the input 
color for the corresponding pixel of the input digital color image. 

9. (currently amended) The method of elaHKhlr claim 19. wherein the set of 
palette colors is determined using a vector quantization algorithm. 

10. (currently amended) The method of ekaaar4 claim 19, wherein the output 
digital color image is formed by assigning each color in the input digital color image to the 
color in the set of palette colors having the smallest color difference relative to the color of 
the input digital color image. 

1 1 . (currently amended) The method of claim 1 claim 19. wherein atop d) step f) 
includes the use of a multi-level halftoning technique to assign each color in the input digital 
color image to one of the colors in the set of palette colors in such a way so as to 
approximately preserve the local mean color value. 

12. (currently amended) The method of claim 1 1, wherein the multi-level 
halftoning technique is an error diffusion technique that distributes the quantization errors 
introduced when processing an input pixel to nearby input pixels that have not yet been 
processed 

13. (currently amended) The method of claim 1 claim 19, wherein the 
distribution of pre-defined important colors is only used to supplement the distribution of 
colors in the input digital color image in color regions where the input digital color image 
contains a significant number of pixels. 

14. cancelled. 
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Page 4 ov 11 

15. (currently amended) The method of eteaa-M- claim 19, where \yh$rein the 
additional pixels axe provided in the form of a predetermined target image. 

16-18. cancelled. 

19, (new) A method for converting an input digital color image having a set of 
possible input colors to an output digital color image having a set of palette colors, the 
number of palette colors being less than the number of possible input colors, wherein the set 
of palette colors is determined based on the distribution of colors in the input digital image 
supplemented by a distribution of pre-defined important colors> comprising: 

a) determining a distribution of input colors using each pixel in Hie input digital 
color image; 

b) providing a pre-determined target image of important colors; 

c) collecting additional pixels from the target image; 

d) adding the collected additional pixels to the distribution of input colors to 
determine a supplemented distribution of colors; 

e) toerminmg a set of palette colors to be used in the formation of an output 
digital color image in response to the supplemented distribution of colors; and 

f) forming the output digital color image by assigning each color in the input 
digital color image to one of the colors in the set of palette colors. 

20. (new) A computer storage medium having instructions stored therein for causing 
the computer to perform a method for converting an input digital color image having a set of 
possible input colors to an output digital color image having a set of palette colors, the 
number of palette colors being less than the number of possible input colors, wherein the set 
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AMfc~yMENT OF SPAXJLDING, ET AL, 

application no. 09/900,565 
Attorney Docket NO-: 0505.0044C 
Page 5 of 11 

of palette colors is determined based on the distribution of colors in the input digital image 
supplemented by a distribution of pre-defined important colors including 

a) determining a distribution of input colors using each pixel in the input digital 
color image; 

b) providing a predetermined target image of important colors; 

c) collecting additional pixels from the target image; 

d) adding the collected additional pixels to the distribution of input colors to 
determine a supplemented distribution of colors; 

c) determining a set of palette colors to be used in the formation of an output 

digital color image in response to the supplemented distribution of colors; and 

f) forming the output digital color image by assigning each color in the input 
digital color image to one of the colors in the set of palette colors. 
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^ y AML^IVTCNT OF SP AULDlNC, ET AL. 

APPLICATION No. 09/900,565 
Attorney Docket no*: O505.0Q44C 
Page 6 of 11 

REMARKS 

Favorable reconsideration in view of the above amendments and the following 
remarks is respectfully requested. New claims 19 and 20 have been added, claims 2-13 and 
15 have been amended, and claims 1, I4» and 16-18 have been cancelled without prejudice or 
disclaimer. Applicants submit that no new matter has been added, and notice to that effect is 
solicited. Applicants further submit that the claims, as now presented, more clearly claim the 
subject matter of the instant application. Upon entry of this amendment, claims 2-13, 15, 19, 
and 20 are pending of which claims 19 and 20 are independent 

The Examiner is thanked for conducting a personal interview with Applicant's 
representative on May 5, 2004. The following serves as an interview summary in satisfaction 
of 37 GFR 1.133 and MPEP 713.04. 

(A) No exhibits were shown or demonstrations conducted. 

(B) All of the claims were discussed, in particular, independent claims 1 and 14. 

(C) The following reference was discussed: Balasubramanian. 

(D) Limitations of the claims were discussed generally, and it was proposed to 
consider clarifying language in the claims. 

(E) The principal thrust of Applicants' argument is that the ched references fail to 
describe or suggest the claimed subject matter. 

(F) No other pertinent matters were discussed in detail. 

(G) Applicants agreed to consider clarifying language in the independent claims. 
In accordance with the foregoing, Applicants have added new claims 19 and 20, and 

amended claims 2-13 and 15, which Applicants submit more clearly presents the subject 
matter of the instant application. 
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AMfc^MENT OF SPAULDINC, ET AL* 

APPLICATION No, Q9#00,565 
Attorney Docket No.: 0505.0044C 
Page 7 OF 11 

Claims 1, 14, and 17 were rejected under 35 USC 112, first paragraph, as failing to 
comply with the written description requirement Claims 2-13, 15, 16, and 18 were rejected 
for depending from rejected claims. 

Claims 1, 14 T and 16-18 have been cancelled as indicated above. Applicants submit 
that this rejection is moot as to these claims. Insofar as the rejection of claims 2-13 and 15 
remains, Applicants submit that the specification describes the objected to term. 

The Examiner does not believe that the specification mentions that the regions of 
important colors are pre-defined. Applicants respectfully submit that the specification, as 
originally filed, does describe this. In particular, for example, on page 8 of the specification, 
sets of important colors that can be used with the subject matter of die instant application are 
described. Important colors are described as "colors that are of high importance to a human 
observer." (lines 7-8). Further, "[s]kin-tone colors are an example of colors that might be 
included in the set of important colors," (lines 10-U) and "[i]n this case, the distribution of 
important colors should generally reflect the expected variations in the skin-tone colors." 
(lines 16-17). Additionally, the specification describes that "[ojther colors that might be 
included in the distribution of important colors Q would be neutal colors and sky colors." 
(lines 17-19). Therefore, Applicants respectfully submit that the specification, as originally 
filed, provides a description of the regions of important colors being predefined, and thus, 
complies with the written description requirement 

Accordingly, withdrawal of these rejections is respectfully requested. 

Claims 14 and 15 were rejected under 35 USC 102 (b) as being anticipated by 
BalaBubramanian et al (Journal of Technology, 1991). This rejection is respectfully 
traversed 1 



-7- 



PAGE 9/13 * RCVD AT 7112/2004 1:37:58 PIYI [Eastern Daylight Time] * SVR:USPT0-EF)KF-2/1 1 DNIS:7466009 * CSID:3017624056 ' DURATION (mra-ss):D3^2 



07/12/04 13:39 FAI 3017624056 



a oio 



■ * AMwMCKNT OF SPAWNING, ET AL. 

APPLICATION NO. 09/900,565 
ATTORNEY DOCKET No.: 0505.0044C 
PAGE 8 OF 11 

Claim 14 has been cancelled as indicated above. As such this rejection is moot as to 
claim 14. Insofar as the rejection of claim 15 remains, Applicants submit that 
B alasubramanian foils to describe or suggest the subject matter of the instant claim. 
Amended claim 1 5 depends from new independent claim 19. 

Independent claim 19 recites a method for converting an input digital color image 
having a set of possible input colors to an output digital color image having a set of palette 
colors. The number of palette colors are less than the number of possible input colors. The 
set of palette colors is determined based on the distribution of colors in the input digital 
image supplemented by a distribution of pre-defined important colors. The method includes 

a) detennining a distribution of input colors using each pixel in the input digital color image; 

b) providing a pre-determined target image of important colors; c) collecting additional 
pixels from the target image; d) adding the collected additional pixels to the distribution of 
input colors to determine a supplemented distribution of colors; e) determining a set of 
palette colors to be used in the formation of an output digital color image in response to the 
supplemented distribution of colors; and f) forming the Output digital color image by 
assigning each color in the input digital color image to one of the colors in the set of palette 
colors. 

Balasubramanian relates to selecting colors for a limited image palatte in which the 
initial number of image colors are reduced and there is pairwise merging of nearest neighbor 
clusters. This is not, however, describe or suggest the claimed method. Balasubramanian 
does not collect additional pixels form the target image and add the collected additional 
pixels to the distribution of input colors to determine a supplemented distribution of colors, 
as claimed. Therefore, Balasubramanian does not describe or suggest the invention of claim 
15. Accordingly, withdrawal of this rejection is respectfully requested. 
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Page 9 of 1) 

Claims 1-5, 9, 10, 13, 16, and 18 were rejected under 35 USC 103(a) as being 
unpatentable over Balasubramanian et al in view of Czako (6,229,523). This rejection is 
respectfully traversed. 

Claims 1,16, and 18 have been cancelled as indicated above. As such this rejection 
is moot as to claims 1, 16, and 18, Insofar as the rejection of claims 2-5, 9, 10, and 13 
remains, Applicants submit that Balasubramanian fails to describe or suggest the subject 
matter of the instant claims, and that Czako is unable to overcome the at least the noted 
deficiencies. Claims 2-5, 9, 10, and 13 depend from new independent claim 19. 

As pointed out above, Balasubramanian relates to selecting colors for a limited image 
palatte. This is not however, describe or suggest the claimed method. Balasubramanian 
lacks at least "determining a set of palette colors to be used in the formation of an output 
digital color image in response to the supplemented distribution of colors," as noted by the 
Examiner in the Action at page 5, paragraph 11. Further, Balasubramanian does not collect 
additional pixels form the target image and add the collected additional pixels to the 
distribution of input colors to determine a supplemented distribution of colors, as claimed in 
independent claim 19. 

Czako relates to digital versatile disc playback system with efficient modification of 
subpicture data. Czako is unable to overcome at least the noted deficiencies in 
Balasubramanian, Therefore, even Balasubramanian in combination with Czako fails to 
describe or suggest the claimed subject matter. 

Accordingly, withdrawal of this rejection is respectfully requested. 

Claims 6-8 were rejected under 35 USC 103(a) as being unpatentable over 
Balasubramanian et al in view of Balasubramanian et al (5,432,893). Claims 1 1 and 12 were 
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AMfcta^MENT OF SP AXJLDINGj 1ST AL. 
AFPUCAtlONNO, 09/900,565 
ATTORNEY DOCKET NO.: 0505.0044C 
Page 10 OF 11 

rejected under 35 USC 103(a) as being unpatentable over Balasubramanian et al in view of 
Gentile et al (Journal of Optical Society of America, 1990). 
These rejections are respectfully traversed. 

Claims 6-8 depend from independent claim 19, which is not described or suggested 
by Balasubramanian alone. As pointed out above, Balasubramanian lacks at least 
"determining a set of palette colors to be used in the formation of an output digital color 
image in response to the supplemented distribution of colors/' as noted by the Examiner in 
the Action, collecting additional pixels form the target image, and adding the collected 
additional pixels to the distribution of input colors to determine a supplemented distribution 
of colors. 

Balasubramanian '893 is unable to overcome at least the noted deficiencies in 
Balasubramanian. Balasubramanian '893 relates to sequential scalar quantizaito of a digital 
color image using mean squared error-minimizing quantizer density function. 
Balasubramanian '893 also lacks at least these features. Therefore, even Balasubramanian in 
combination with Balasubramanian *893 fails to describe or suggest the inventions of claims 
6-8. 

Similarly, Gentile is unable to overcome at least the noted deficiencies in 
Balasubramanian, Gentile relates to selecting a set of output colors in alternate color spaces 
chosen on a perceptual basis for digital devices for display or printing of color images. 
Gentile also at leasta lacks "detennimng a set of palette colors to be used in the formation of 
an output digital color image in response to the supplemented distribution of colors/' as 
noted by the Examiner in the Action, collecting additional pixels form the target image, and 
adding the collected additional pixels to the distribution of input colors to determine a 
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Pace li opII 



supplemented distribution of colors. Therefore, Balasubramanlan in combination with 
Gentile also fails to describe or suggest die inventions of claims ] 1 and 12 T 

Accordingly, withdrawal of these rejections is respectfully requested. 

As to the new and amended claims, Applicants submit that these claims are allowable 
over the cited art of record. As more clearly presented, independent claim 19 describes that 
additional pixels can be provided in the form of a pre-determined target image (see 
specification, page 9). 

Applicants submit that the pending claims are in condition for allowance, and formal 
notice qf such is solicited If the Examiner has any questions, he is respectfully requested to 
contact the undersigned at the number listed below. 




Respectfully submitted by 



Edell, Shapiro & Finnan, LLC 

Customer No, 27896 

1901 Research Boulevard, Suite 400 

Rockville, MD 20850 

(301) 424-3640 




Heather Morin 
Reg. No. 37,336 
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